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EMBEDDING DIGITAL WATERMARKS IN SPOT COLORS 


Related Application Data 
[0001] This application is related to U.S. Patent Application No. 09/553,084, titled 
"Color Adaptive Watermarking/' filed April 19, 2000, which is a continuation in part of 
U.S. Patent Application No. 09/503,881, filed February 14, 2000, which is a continuation 
in part of apphcation 09/186,962, filed November 5, 1998, which is a continuation of 
U.S. Application No. 08/649,419, filed May 16, 1996, now U.S. Patent 5,862,260. 

Field of the Invention 

[0002] The present invention relates to digital watermarking systems and methods, and 
is particularly illustrated with reference to digitally watermarking spot color media. 

Background and Summary of the Invention 
[0003] Digital watermarking technology, a form of steganography, encompasses a great 
variety of techniques by which plwal bits of digital data are hidden in some other object, 
preferably without leaving human-apparent evidence of alteration. 

[0004] Digital watermarking may be used to modify media content to embed a 
machine-readable code into the media content. The media may be modified such that the 
embedded code is imperceptible or nearly imperceptible to the user, yet may be detected 
through an automated detection process. 

[0005] There are many processes by which media can be processed to encode a digital 
watermark. Some techniques employ very subtle printing, e.g., of fine lines or dots, 
which has the effect sUghtly tinting the media (e.g., a white media can be given a 
lightish-green cast). To the human observer the tinting appears imiform. Computer 
analyses of scan data from the media, however, reveals slight localized changes, 
permitting a multi-bit watermark payload to be discerned. Such printing can be by ink 
jet, dry offset, wet offset, xerography, etc. Other techniques involve varying the intensity 
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or luminance of pixel colors. Of course there are many other digital watermarking 
techniques. 

[0006] Digital watermarking systems typically have two primary components: an 
embedding component that embeds the watermark in the media content, and a reading 
component that detects and reads the embedded watermark. The embedding component 
embeds a watermark pattern by altering data samples of the media content. The reading 
component analyzes content to detect whether a watermark pattern is present. In 
appUcations where the watermark encodes information, the reading component extracts 
this information from the detected watermark. U.S. Patent Apphcation No. 09/503,881, 
filed February 14, 2000, discloses various encoding and decoding techniques. U.S. 
Patent Nos. 5,862,260 and 6,122,403 disclose still others. Of course, artisans know many 
other watermarking techniques. 

[0007] One digital watermarking application involves watermarking print media such 
as magazine or newspaper advertisements, brochures, artwork, company logos, graphics, 
pictures and photographs, etc. In this case, a digital watermark is typically embedded in 
an image that is printed using a multi-color printing process. For example, the printing 
may include a cyan (C), magenta (M), yellow (Y) and black (K) process. CMYK ink 
intensities can be varied to modulate an image's luminance to accommodate a digital 
watermark signal. The individual CMYK values at a given image area (e.g., a pixel or 
other image area location) of an unmarked image can be represented as (C^ , , 7^ , X"^ ) , 
and the individual values for the watermarked given area (or pixel) are 

5 y^m^^m)' ^ach color quantity preferably represents an intensity percentage of 
the corresponding color ink. If the watermark signal requires a luminance change of a at 
this location, then: 


(1) (C^M^J^.KJ ^HC^+aACMo-^aAMJ^+aAY^KJ. 
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where (AC, AM, A7) forms a scaling vector in CMY coordinates with a normalized 
projection onto a luminance axis. Different methods can be used to choose the direction 
of this scaling vector. For example, scaling may occur along a direction between white 
and an immarked color, or scaling along the direction between black and the unmarked 
color. Consider Figs. 1 and 2 for further illustration. 

[0008] While the implementation details of watermark encoding schemes vary 
significantly, a class of watermarking schemes can be modeled as an array of changes to 
luminance values of a host image. A host image comprises an array of color vectors 
(e.g., an array of color such as RGB, CMY, CMYK, etc). The image sample may be 
represented as a vector between white and the pixel color value. To encode a watermark, 
the luminance of the image sample may be increased or decreased by adding a watermark 
vector in a variety of directions. This is because many possible watermark vectors have 
components along the luminance axis. Two useful directions for orienting the watermark 
vector are along a vector between black and the watermark color, and along a vector 
between white and the watermark vector. Using the former direction for the watermark 
vector is shown in Fig. 1 . Fig. 1 shows a 3-dimensional color space with cyan (C), 
magenta (M) and yellow (Y) axes. The bold axis between black and white represents 
luminance. To make an equivalent luminance change in an image sample of a given 
color vector (CI, Ml, Yl), one may make a corresponding scale to black as shown. 

[0009] An alternative method of obtaining the same luminance change is to scale the 
image sample like a vector between white and the sample's color value as shown in Fig. 
2. To make an equivalent luminance change, one may make a corresponding scale to 
white as shown. Of course a linear combination of these two scahng methods (white to 
color and black to color) can also be used to effect a luminance change. 

[0010] By using the scale to white method for colors with high yellow content such as 
yellow, red and green, and scale to black for blue, cyan and magenta, a lower visibihty 
watermark can be encoded with the same detectability. 
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[0011] Once the color vector entries are established, each of the entries is associated 
with a set of scale factors. The set includes a scale factor for each color component. The 
specific color components in the implementation depend on the color format of the 
image. For example, images in an RGB format have scale factors for each of the R, G 
and B color components. Similarly, images in a CMY format have scale factors for each 
of the C, M and Y components of each table entry. 

[0012] Further reference for such scaling techniques may be made to previously 
mentioned U.S. Patent Application No. 09/553,084. 

[0013] In watermarking items such as product packaging, brochures, graphics, logos, 
labels, etc., sometimes an original printed image is rendered using "spot color" inks to 
reproduce a specific desired color. A spot color is a specific color ink, and in some cases 
may lie outside the CMYK (or CMY) printing gamut. A spot color can be halftone- 
screened (or filtered) to achieve various shades of the original spot color. Embedding a 
digital watermark in a spot color presents a unique set of problems - these are the 
problems the present invention addresses. One conventional approach often falls short 
of solving these problems. This conventional approach produces an approximation of the 
spot color image using only CMY or CMYK inks. A digital watermark signal is 
embedded through modulating (or changing) various CMYK pixel (or other image area) 
intensities. Since the original spot color may lie outside the CMYK gamut, this first 
approach can yield poor results. 

[0014] The present invention provides various methods to effectively embed a digital 
watermark signal in a spot color. To watermark an original spot color in a first 
embodiment, the original spot color is replaced with a combination of spot color and 
process inks. For example, cyan (C), magenta (M) and yellow (Y) process components 
are modulated (e.g., intensity or luminance varied) to include a watermark signal. The 
CMY components are preferably combined with a halftone-screened (or scaled) version 
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of the original spot color (e.g., a percentage of the original spot color intensity) to 
approximate the original spot color. Preferably, the resulting watermarked spot color 
approximation closely resembles the original spot color. 

[0015] In a second embodiment, a spot color is "screened back" to some percentage of 
its original intensity (e.g., 95%). The watermark signal is added to the screened back 
spot color as intensity tweaks to modulate the spot color at various pixel locations. As a 
variation, a spot color is modulated in accordance with a predetermined level along a 
screening range of the spot color intensity. As another variation, a non-screened-back 
spot color (e.g., a spot color at 100% intensity) is negatively modulated at various pixel 
locations to acconmiodate a watermark signal. 

[001 6] The foregoing and other features and advantages of the present invention will be 
more readily apparent from the following detailed description, which proceeds with 
reference to the accompanying drawings. 

Brief Description of the Drawings 

[0017] Fig. 1 is a diagram of a color space depicting how to scale a color vector to 
black to effect a change in luminance. 

[0018] Fig. 2 is a diagram of a color space depicting how to scale a color vector to 
white to effect a change in luminance. 

[0019] Fig. 3 is a diagram of a color space depicting the combination of a spot color 
with cyan, magenta and yellow components. 

[0020] Fig. 4 is a flow diagram depicting an embedding method according to the 
present invention. 
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[0021] Fig. 5 is a flow diagram depicting a screened-back spot color embedding 
method. 

[0022] Figs. 6a and 6b are a diagrams showing intensity tweaks at various screened- 
back spot color percentages. 

Detailed Description 

Introduction 

[0023] In image processing applications, it is sometimes useful to be able to alter the 
colors of an image while reducing the visibility of these changes. Image watermarking is 
one application where it is desirable to alter image samples to encode information in a 
manner that is readily recoverable by an automated process, yet substantially 
imperceptible to human visual perception. This is particularly relevant when 
watermarking spot colors. 

Embedding in Spot Color Images 

[0024] Our inventive methods are directed toward watermarking images printed 
with spot color inks. In a first embodiment, to embed a digital watermark in an 
original spot color (S), we replace the original spot color (S) with a combination 
of CMY inks (Cm, M^, Y^) and a scaled or halftone screened version (Sm) of the 
spot color (S). The screened spot color (S^) is preferably a percentage of the 
original spot color (S) intensity (Fig. 3). We also refer to this process as "filling" 
or "fiUing-in" a spot color. 

[0025] With reference to Fig. 4, for a given pixel (or other image area), a CMYK value 
is determined to approximate the original spot color (S), as shown in step SI. This 
CMYK approximation is preferably converted to a CMY approximation by a known 
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black recombination equation or method (step S2). The resulting CMY approximation is 
represented as (C^ , M ^ ^Ys) - 

An example of a recombination method is provided in Equation 2, below: 

y5 = 0.01 

(2) 

=Y-^K-/3YK 

Of course, the j8 value can be varied without deviating jfrom the scope of the present 
invention. Similarly, other known recombination techniques can be suitable interchanged 
with the present invention. 

[0026] Alternatively, a CMY approximation is initially determined to approximate the 
original spot color (S), without first determining a CMYK approximation. 

[0027] The CMY components are modulated (e.g., intensity or luminance 
varied) to accommodate a watermark signal. Of course, the modulation may be 
selective over an area - influencing only a subset of the area's locations. The 
screened spot color component Sm and watermark carrying color components Cm, 
Mm and Ym are combined (S^ , C^,M^ ,Y^) to replace the original spot color (S) 
as in step S5. The resulting color W preferably closely approximates the original 
spot color S. (Each color component (S^ , C^,M^ , 7^ ) is preferably represented 
as an intensity percentage, or other measure, of its corresponding spot color or 
color processing ink.). For a CMY color space, a digitally watermarked pixel (or 
image area) is represented as a combination of four inks. This combination 
carries a watermark signal via the (Cm, Mm and Ym) channels. Such a 
combination also allows a luminance modulation-scaling vector (v in Fig. 3) to be 
oriented in multiple directions in the CMY color space. 
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[0028] The watermark carrying color components (Cm, Mm and Ym) preferably include 
a relationship between the spot color component Sm and the CMY spot color 
approximation (C^ ,M^,7J . Ideally, the spot color component Sm is as large as possible, 
while still being able to accommodate (e.g., add) the watermarked color components 
without significantly shifting the average color fi-om the original spot color (S) intensity. 
Using the notation above for a CMY scaling vector, the CMY ink values can be related 
as: 

C.-(l-5JC,+aAC; 
(3) M^={1- + aAM; and 

where a represents a respective luminance change in a scaled (e.g., A) C, M or Y to 
accommodate the watermark signal. The combination of the spot color component term 
(1- 5^ ) and the Cs, Ms and Yg terms of the above equations (3) preferably result in a close 
approximation of the original spot color (S). Since the proportion of the screened spot 
color (Sm) to CMY is preferably large, this approximation is closer to the original spot 
color (S) than an approximation using only CMY or CMYK inks. The aAC, aAM and 
aAY terms of the above equations (3) account for the watermark signal, which can lie 
along a desired scaling vector (v). 

[0029] Now consider the following illustrative methods to help determine the amount 
(or percentage) of spot color (Sm) to combine with the CMY components (or percentages 
of components). 

[0030] A first method considers each image point (e.g., a pixel or other image area). 
This method uses a maximum possible value of spot color (Sm) consistent with the above 
equations (3). The spot color value (Sm) is preferably chosen to render one of the CMY 
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values iC^Mnt^Ym) ^^^^^ to (or near) zero, if possible. If this is not possible, then the 
spot color (Sm) is preferably set to 100% of the original spot color (S) intensity for that 
image point. The following equation may be used to select a screened spot color Sm 
value to achieve a zero Cm, Mm or Ym value: 


(4) 


S„ =min 


aAM 


+ 1 


+ 1 


+ 1 


[0031] The minimum value ("min") selected from equation 3 preferably renders at least 
one of Cm, Mm and Ym zero. Note that the luminance change a may be positive or 
negative, and preferably AC, AM, A 7 are each negative (e.g., since adding ink reduces 
luminosity). A value for larger than the equation 3 value is preferably not used, since 
such a larger value would require at least one of the process ink values , to be 

negative. 

[0032] A second method for determining a value for spot color intensity Sm uses a fixed 
value for Sm across a subject spot color area. This may be desirable because dot gain can 
make accurate signal modulation of the spot color difficult. Dot gain is a phenomenon, 
e.g., in which a printed ink spot on paper appears larger than a desired size. One cause of 
dot gain is ink soaking into paper. The reason for dot gain causing problems with spot 
color modulation is that the spot color value will be near 100%, where the dot gain 
characteristic is most nonlinear. A fixed value for spot color intensity can be chosen by 
calculating the value for (e.g., via the first Sm determining method above) for some or 

all of the spot color pixels in a spot color area. A minimum value of these Sm values is 
then preferably used as the fixed Sm- 
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[0033] A combination of CMY inks and the screened spot color (Sm) can be 
used to approximate an original spot color (S) while still providing a watermarked 
color (W in Fig. 3). In this regard, the spot color is "filled in" by a CMY (or 
CMYK) combination. The CMY luminance (or intensity) values can be 
modulated (or varied) to accommodate the watermark signal. In one embodiment, 
a large percentage halftone screening (Sm) of the original spot color ink (S) is 
used. This helps to keep the resulting watermarked image color as close to the 
original spot color (S) as possible, even if the original spot color is out of the 
CMYK process color gamut. The spot color (S) can be screened through a 
conventional halftoning process to effectively reduce the intensity of the spot 
color (S). The combination of the screened spot color (Sm) and CMY color 
components can then be printed, e.g., with the aid of a halftoning process or other 
printing process. Examples of suitable halftoning techniques include ordered 
dither (both clustered and diffused dot), error diffiision, and blue noise masking, 
among other techniques. 

[0034] Not all printing processes accommodate both spot color inks and CMY (or 
CMYK) process printing inks. Indeed, adding additional CMY printing plates to a spot 
color printing process may, in some cases, increase printing costs and complicate the 
overall printing process. 

[0035] Accordingly, we have developed a second embodiment in which part or all of an 
original spot color is screened back, e.g., using one of the halftoning techniques 
mentioned above. This method focuses on manipulating the original spot color instead of 
supplementing or filling in the spot color with CMY or CMYK process inks. 

[0036] With reference to Fig. 5, an original spot color is screened back to a percentage 
of its original intensity (SIO). Most often this screening back process is accomphshed in 
a digital domain, in which the spot color is represented as an intensity percentage or as a 
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color level Of course physical screening processes are well known as well. The 
intensities (or luminance) at various image areas in the screened-back spot color are 
modulated (or varied) to embed positive and/or negative watermark signal components 
therein (S12). For example, an intensity percentage can be shifted up or down (e.g., 
"tweaked") to accommodate a watermark signal component at a given image area (or 
pixel). In one case, the watermark tweaks collectively have a zero mean, e.g., meaning 
that for every positive tweak there is a corresponding negative tweak. Or a watermark 
signal is embedded with negative tweaks (e.g., a negative "channel") and then 
repetitively embedded at corresponding image areas with positive tweaks (e.g., a positive 
"channel"). In other cases, the collective mean may be positive or negative in relation to 
the screened-back spot-color intensity. The resulting modulated spot color includes an 
embedded digital watermark signal (SI 4). 

[0037] Now consider the graphs shown in Figs. 6a and 6b, where spot color intensity, 
e.g., representing a percentage of an original or 100% spot color, is illustrated in relation 
to intensity tweak percentage size (vertical axis). A watermark signal is preferably 
embedded with a plurality of intensity tweaks arranged at various images areas (e.g., 
pixels or pixel blocks). Typically, such embedding results in one tweak per pixel or pixel 
area. At a 95% intensity level (20 in Fig. 6a) a maximum positive tweak size is 5%, 
raising the 95% intensity to 100% for a given pixel (or pixel block). To achieve a zero- 
mean watermark signal, a corresponding negative tweak size is 5%, lowering the 95% 
intensity to 90%> at a corresponding pixel (or image area). Of course the positive tweak 
size at a 95% level can range in size from 1-5 %, and a corresponding negative tweak 
preferably ranges in size from 1-20%. 

[0038] At a 100 % spot color intensity level (22), only a negative tweak is possible. 
Here, the spot color is not screened back. At the 100% level the range of negative tweaks 
preferably falls within a 1 - 20 % size range. At level 22 a watermark's visibility may be 
affected since all tweaks are negative, e.g., resulting in a non-zero mean watermark 
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signal. Moving away from the 100% level to lower screened-back intensities allows for 
both positive and negative tweaks. 

[0039] Now consider an embodiment in which a watermark tweak "level" remains 
constant as spot color intensity percentages vary (e.g., from 100%-95%). A tweak level 
includes the sum of a negative and positive tweak size. For example, a 5% positive 
tweak size and a 5% negative tweak size result in a watermark tweak level of 10%. Or a 
10% positive tweak size and a 10% negative tweak size result in a tweak level of 20%. 
Of course a tweak level can be determined to best suit a particular apphcation, e.g., to 
accommodate factors such as watermark visibility and detectability. With reference to 
Fig. 6a, a tweak level of 10% preferably remains constant as spot color intensity varies 
from 100% to 95%. At the 99% intensity level, the positive tweak size is 1%, while the 
negative tweak size is 9%. And at the 98% intensity level the positive tweak size is 2%, 
while the negative tweak size is 8%, and so on. Maintaining a constant watermark tweak 
level allows for consistent application of a watermark signal across varying spot color 
intensities. 

[0040] The idea of a constant tweak level helps to ensure a consistent ability to read the 
watermark. Other factors to consider include a dynamically calculated tweak size to 
produce a constant watermark level. 

[0041] Another embedding factor is a spot color's abiUty to carry or hide a watermark 
signal. Our research has shown that a spot color's characteristics, e.g., a spot color's 
luminosity level, can influence the optimum watermark tweak level. Accordingly, the 
percentage tweak size can be established according to the spot color's luminosity. 

[0042] Alternative methods are used to handle halftone-screened spot colors at a 94%) 
intensity level and below. Li a first altemative, a positive watermark tweak is adjusted to 
raise the total spot color percentage to 100%o 6% at the 94% intensity level. The 
negative tweak can be adjusted at the 94% level to maintain a desired tweak level -- 4% if 
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the tweak level is 10%. In a second alternative, the positive and negative tweak levels are 
capped at, e.g., 5%. At the 94% screened-back level the maximum spot color intensity at 
any pixel (or other image area) is then 99%. 

[0043] With reference to Fig. 6b, a spot color is halftone-screened to yield a low 
intensity spot color, e.g., 1-5% of its original intensity. If a constant tweak level of 10 % 
is desired, a 9%o positive tweak size can be apphed to a pixel with 1% intensity, or only a 
1% negative tweak size would be allowable. Similarly, at a 2% intensity level, an 8% 
positive tweak size or a 2% negative tweak size is permitted. 

[0044] Of course, other tweak levels can be determined, and, can vary from screened- 
back spot color percentage to percentage. For example, at a 99%> level, the tweak level 
can be 10%, while at a 97% level the tweak level can bel3% (e.g., with a 10% negative 
tweak size) or so on. 

[0045] A further advantage of the present invention is that the inventive spot color 
watermark is fragile. As will be appreciated, a fragile watermark is destroyed or 
degrades predictably with signal processing, e.g., scanning/copying, compression, etc. 
For example, a typical counterfeiting attempt will scan a watermarked spot color with an 
RGB scanner. The spot color and CMY components (if any) are converted into RGB, 
which typically distorts the spot color quality and CMY components - particularly when 
the spot color (and/or CMY components) is out of RGB color gamut. 

Conclusion 

[0046] The foregoing are just exemplary implementations of the present invention. It 
will be recognized that there are a great number of variations on these basic themes. The 
foregoing illustrates but a few apphcations of the detailed technology. There are many 
others. 
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[0047] The section headings in this application are provided merely for the reader's 
convenience, and provide no substantive Umitations. Of course, the disclosure under one 
section heading may be readily combined with the disclosure under another section 
heading. 

[0048] The term "spot color" is used broadly herein, hi some case spot color refers to a 
spot color pixel, hi other cases, the term refers to a spot color area or image. Similarly, 
the term "paper product" includes paper, paper-fiber combinations, banknote paper 
materials, fabrics, cardboard, stock board, bond paper, copy paper, thermal paper, 
newspaper, etc., and various combinations of such. 

[0049] Some of the embodiments discussed herein have been illustrated with reference 
to four ink intensities (S, C, M, Y). The present invention is not so limited. Of course, 
an image may include additional spot colors and/or processing inks. Also, different color 
spaces (e.g., RGB) may benefit from the inventive techniques. It will be appreciated that 
the term "pixel" is used generally throughout this document. Pixel can include an image 
area, a pixel, a block of pixels, etc. 

[0050] To provide a comprehensive disclosure without unduly lengthening this 
specification, each of the above-mentioned patents and patent apphcations are hereby 
incorporated by reference, along with U.S. Patent AppUcation No. 09/689,226, filed 
October 1 1, 2000. The particular combinations of elements and features in the above- 
detailed embodiments are exemplary only; the interchanging and substitution of these 
teachings with other teachings in this application and the incorporated-by-reference 
patents/applications are expressly contemplated. 

[0051] The above-described methods, inventive spot color watermarks and related 
functionality can be facilitated with computer executable software stored on computer 
readable media, such as electronic memory circuits, RAM, ROM, EPROM, flash 
memory, magnetic media, optical media, magnetic-optical media, memory sticks, hard 
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disks, removable media, etc., etc. Such software may be stored and/or executed on a 
general-purpose computer, or on a server for distributed use. Data structures representing 
the various luminance values, methods, embedded images, spot color signals, data 
signals, luminance values, etc., may also be stored on such computer readable media. 
Also, instead of software, a hardware implementation, or a software-hardware 
implementation can be used. 

[0052] In view of the wide variety of embodiments to which the principles and features 
discussed above can be apphed, it should be apparent that the detailed embodiments are 
illustrative only and should not be taken as limiting the scope of the invention. Rather, 
we claim as our invention all such modifications as may come within the scope and spirit 
of the following claims and equivalents thereof 
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